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WE CLAIM: 

1. An execution unit that maintain/ substantially peak data throughput 
in the unified execution of multiple media data streams, the execution unit having 
a data path, comprising: / 

a multi-precision arithmetic unit coupled to the data path, the multi- 
precision arithmetic unit capable of dynzuhic partitioning based on the elemental 
width of data received from the data path; 

a switch coupled to the/iata path and programmable to manipulate 
data received from the data path, thef switch providing data streams to the data 
path; and / 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
peak data throughput. / 

2. The execution unit defm^Mn claim 1, wherein the multi-precision 
execution unit is configurable to divide^mg^ into component symbols of various 
sizes, analyze the com^nent symbols^toasetf upon instructions, and re-synthesize 
the component symbols for commumcation over the data path. 

3. The/execution unit defmed in claim 2, wherein the multi-precision 
execution unit is/operable to perform unique operations on each component 
symbol. / 

4. / The execution unit defmed in claim 2, wherein the mathematical 
element isyOperable to perform fmite group, finite field, finite ring and table look- 
up operations on the symbols. 

A. The execution unit defmed in claim 1, wherein the arithmetic unit is 
progAmmable to perform Boolean, integer and floating point mathematical . 
operations. 
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6. The execution unit defined in claiin 5, wherein the operations 
performed by the arithmetic unit are capable oy being performed at various levels 
of precision. 

7. The execution unit defined in/claim 1, wherein the manipulation of 
data comprises copying, shifting and re-sizing data. 



10 



8. The execution unit defined /in claim I, further comprising control to 
maximize use of the execution unit by performing operations at peak data width of 
the data path. 
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9. The execution unit defpied in claim 2, wherein the size of 
component symbols match. 

15 10. An execution unit hAving a dat&ypath, compnsmg: 

at least one register file coumb^to data path; 
a multi-precision mthmetic Ainit coupled to the data path, the multi- 
precision arithmetic unit capable of dynancac partitioning based on the elemental 
width of data received from tl/e data path; 
20 a switch coupLfed to the data path and programmable to manipulate 

data received from the datapath, the switch providing data streams to the data 
path; and 

an extended mathematical element coupled to the data path and 
programmable to impleipent additional mathematical operations at substantially 
25 peak data throughput. 



11. An em:ution unit having a data path, comprising: 

a multi-precision arithmetic unit coupled to the data path, the multi- 
precision arithmetic unit capable of dynamic partitioning based on the elemental 
30 width of data received from the data path; 
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P^o the data path for manipulating data received from 
laniptuating data being programmable and providing 
l^ematical element coupled to the data path and 
iditional mathematical operations at substantially 

12. A generalNpurpose programmable media processor having an 
instruction path and a data\path to digitally process a plurality of media data 
10 streams, comprising: 

a high bandwidth external interface operable to receive a plurality of 
data of various sizes from an external source and communicate the received data 
over the data path at a rate that f^aintains substantially peak operation of the media 
processor; 

15 at least one register fale configurable to receive and store data from 

the data path and to communicate the^ stored data to the data path; and 

a multi-precision execution unit coupled to the data path, the multi- 
precision execution unit configurable to partition data received from the data path 
to account for the elemental symbol size oXthe plurality of media data streams, 
20 and programmable to operate on the data to generate a unified symbol output to 
*^th e d ata path \ 



/ 

The media processor defined in claim wherein the execution unit 
is dynamically configurable to partition data received from the data path. 



^}^^ The media processor defined in claim >2r, further comprising: 
means for moving data between registers and memory by 
performing load and store operations, and for coordinating the sharing of data 
among a plurality of tasks by performing synchronization operations based upon 
30 instructions and data received by the execution unit; 
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means for securely controlling the sequence of execution by 
performing branch and gateway operations based upon instructions and data 
received by the execution unit; and 

a memory management unit, the memory management unit operable 
to retrieve data and instructions for timely and secure communication over the data 
path and instruction path. 

>5: The media processor defined in claim >4, further comprising: 

a combined instruction cache and buffer, the combined instruction 
cache and buffer dynamically allocated between cache space and buffer space to 
ensure real-time execution of multiple media instruction streams; and 

a combined data cache and buffer, the combined data cache and 
buffer dynamically allocated between cache space and buffer space to ensure real- 
time response for multiple media data streams. 

The media processor defined in claim 15, wherein real-time 
execution is ensured by dynamically allocating instruction buffer space to the 
smallest and most frequently executed blocks of media instructions. 

^\Pl The media processor defined in claim }5, wherein real-tmie 
response is ensured by dynamically allocating data buffer space to the smallest and 
most frequently accessed working sets of media data. 

^ The media processor defined in claim J^, wherein media data 
streams comprise Nyquist sampled inputs and outputs. 

The media processor defined in claim wherein media data 
streams originate from standard computer memory and I/O interfaces. 

The media processor defined in claim wherein the multi- 
precision execution unit is configurable to divide the data into component symbols 

■ 49 - 
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of various sizes, analyze the component symbols based upon instructions, and re- 
synthesize the component symbols for communication over the data path. 

^ The media processor defined in claim iC wherein the plurality of 
media data streams comprise presentation media information, transmission media 
information, and storage media information. 

The media processor defined in claim wherein presentation 
media information comprises audio, video, image, and graphical information. 

The media processor defined in claim wherein transmission 
media information comprises radio and network data transmissionsj. 

15 lO 

The media processor defined in claim wherein storage media 
information comprises data encoded in moving and solid-state memory media. 

The media processor defined in claim i2f, wherein the width of the 
data path is at least 128 bits. 

^ The media processor defined in claim wherein the multi- 
precision execution unit comprises a dynamically partitionable arithmetic unit, a 
register controllable cross-bar switch, and an extended mathematical element. 

\^ 13 

3?f, The media processor defined in claim wherein the register 
controllable cross-bar switch comprises a Benes network design. 

7^, The media processor defined in claim wherein the register 
controllable cross-bar switch is programmable and is operable to manipulate 
symbols. 
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The media processor defined in claim wherein the extended 
mathematical element is operable to perform finite group, finite field, finite ring 
and table look-up operations on the symbols. 

3a The media processor defined in claim >k; further comprising a set 
of predefined instructions accessible by a user. 

31. The media processor defined in claim yS, wherein the means for 
performing load, store, and synchronization operations and the means for 
performing branch and gateway operations comprises a set of predefined 
instructions accessible by a user. 

la. The media processor defined in claim 3^, wherein the predefined 
instructions are combinable to implement composite functions on the plurality of 
media data streams. 

33. A high bandwidth processo/ interface for receiving and transmitting 
a media stream, comprising: 

a data path, the data ^th operable to transmit media information at 
sustained peak rates; 

a plurality of merftory coptroUers, the plurality of memory 
controllers coupled to the data path in sekes to communicate stored media 
information to and from data "^wi,^^^ 

a plurality of memory elements coupled to each of the plurality of 
memory controllers in parallel, the plurality of memory elements for storing and 
retrieving the media information. 

34. / The high bandwidth processor interface defined in claim 33, 
wherein ttie data path comprises a plurality of data paths forming a high bandwidth 
data chwmel. 
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35. The high bandwidth processo/ interface defined in claim 34, 
wherein the high bandwidth data channel i^ uni-directional. 

/ssor interface defined in claim 33, further 
table media processor coupled to the high 
ess and transmit media information at 

37. The high bandwidtli processor interface defined in claim 33, 
wherein the peak rate of operation comprises at least one gigabyte of information 
per second from point to point: 

38. The high bandwidth proce^r unerface defined in claim 33, 
wherem the plurality of m|fcmory controllers each comprise a paired link disposed 
between each memory controller, thp^toed^nks each for transmitting and 
receiving plural bits of data and havmg differential data inputs and outputs and a 
differential clock signal. 1/ 

39. The high bandwidth processor interface defined in claim 38, 
wherein the paired/link further comprises a digital skew calibrator to adjust the 
plural bits of data/ relative to the differential clock signal to eliminate skew 
between the data. 

40. /The high bandwidth processor interface defined in claim 38, 
wherein the paired link further comprises a phase locked loop to eliminate jitter in 
the differential clock signal transmitted between paired links. 

41. The high bandwidth processor interface defined in claim 38, 
wherein/the plural bits comprise eight bits of data. 



36. The high bandwidth pi 
comprising a general purpose program^ 
bandwidth data channel to receive, p^ 
substantially peak rates. 
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42. The high bandwidth processor interface defined in claim 38, 
wherein the paired links each further comprise termination resistors to form 
matched impedances for each paired linkJ 

43. The high bandwidth processor interface defined in claim 34, 
wherein the high bandwidth data chanijel comprises plural parallel high bandwidth 
data channels. 



44. A system for unified media processing comprising: 
10 a plurality of generay purpose media processors, each media 

processor operable at sustained pefik data rates and having a dynamically 
partitioned execution unit and a mgh bandwidth interface, the high bandwidth 
interface coupled to external memory and input/output elements to receive and 
transmit data to the media processor at substantially peak rates; 
15 a bi-directionaiycommunicadon fabric, the plurality of media 

processors coupled to the bi-directionai commuiiication fabric to transmit and 
receive at least one media s/ream coip^nsing presentation, transmission, and 
storage media informationy 

20 45. The system defined in claim 44, wherein the bi-directional 

communication fabric comprises a fiber optic network. 
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46. The system defined in claim 44, wherein the bi-directional 
communication fabmc comprises an heterogeneous network. 

47. Thjfe system defined in claim 44, wherein the bi-directional 
communication fabric comprises a coaxial cable network. 
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48. fho system defined in claim 44, wherein the bi-directional 
communicatio/i fabric comprises a wireless network. 



-53 - 



-54 

49. The system defined in clain/ 44, wherein a subset of the plurality of 
media processors comprise network servers. 

50. The system defined m claim 44, wherein the plurality of media 
processors are programmable by (downloading program information over the bi- 
directional communication fabi>^ 

51. The system lefefined in cl^jfi 44, wherein the each of the plurality of 
media processors can access an idle emrution unit of another media processor in a 
shared manner to efficiently processypyes^nt^ion, transmission and storage media 
information at subsmitially peak ism rates., 

52. The system defined in claim 44, wherein each media processor 
further composes dedicated memory and wherein the each of the plurality of 
media processors can employ any unused portion of the dedicated memory of 
another media pnx^essor in a shared manner to efficiently store and retrieve 
presenmtion, transmission and storage media information at substantially peak data 
ratfi^. 



53. A parallel multi-processor system that maintains substantially peak 
data throughput in tnbsunified execution of multiple media streams, the system 
having a data path, coni^sing: 

at least one high bandwidth external interface, the at least one high 
bandwidth external interface mipled to the data path and operable to receive a 
plurality of data of various sizes Vom an external source and communicate the 
received data at a rate that maintaii\substantially peak operation of the parallel 
multi-processor system; 

a plurality of register files)seach register file having at least one 
general purpose register coupled to the dataVath and operable to store a working 
set of mcdia - data pffifRh 



- 54 - 



-55 - 

at least multi-precision execution unit coupled to the data path, 
the at least one multi-predsion execution unit dynamically configurable to partition 
data within a working set of media data received from the data path to account for 
the elemental symbol size of the plurality of media streams, and programmable to 
operate in parallel on working se^s of data stored in the plurality of register files to 
generate a unified symbol output fOT. each register file. 

95- 

*^^54r The parallel multi-processor system defmed in claim >5, wherem 
the at least one execution unit alternates in a round robin manner to operate on 
data stored in the plurality of register files. 

The parallel multi-processor system defmed in claim further 
comprising an instruction pre-fetch pipeline. 

^5^. The parallel multi-processor system defmed in claim $8, wherein 
the instruction pre-fetch pipeline comprises a super-string pipeline. 

^yf^. The parallel multi-processor system defined in claim 55^ wherein 
the instruction pre-fetch pipeline comprises a super-spring pipeline. 

The parallel multi-processor system defined in claim 53^, further 
comprising a data pre-fetch pipeline. 

The parallel multi-processor system defmed in claim wherein 
the data pre-fetch pipeline comprises a super-string pipeline. 

The parallel multi-processor system defined in claim ^ wherein 
the data pre-fetch pipeline comprises a super-spring pipeline. 

^f(f. The parallel multi-processor system defined in claim 5^, further 
comprising a requester, responder and transponder daemon. 
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62. A method for processing unified st/eams of media data, comprising 
the steps of: 

receiving a stream of unified me^ia data including presentation, 
transmission and storage information; 

dynamically partitioning the umfied stream of media data into 
component fields of at least one bit based o^ the elemental symbol size of data 
received; and 

processing the unified strej{m of media data at substantially peak 

operation. 

63. The method defmed in^claim 62, wherein the step of processing the 
unified stream of media data composes the steps of: 

storing the stream or unified media data in a general register file; 

performing multi-precision ^hijietic operations on the stored 
stream of unified media data based on py 
precision arithmetic operation^ includi 
mathematical operations; 

manipulatinmhe component fields of unified media data based on 
programmed instructions ^at implement copying, shifting and re-sizing operations; 
and 

performing multi-precision mathematical operations on the stored 
stream of unified mecpa data based on programmed instructions, the mathematical 
operations including/finite group, finite field, finite ring and table look-up 
operations. 




'med instructions, the multi- 
, integer and floating point 
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e method defmed in claim 63, further comprising the steps of: 
-fetching instructions and data to fill instruction and data 



performing memory management operations to retrieve instructions 
external memory; 
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storing instructions and data in instruction and data cache/buffers; 



and 



dynamically allocating buffer storage in the instniction and data 
cache/buffers to ensure real-time execution. 

65. The method defined in claim 63, further comprising the step of 
providing a set of instructions to process the stream of unified media data, the set 
of instructions including load, store/ synchronization, branch and gateway 
instructions. 



66. The method defined in claim 65, further comprising the step of 
programming a sequence of ay least one mstruction from the set of instructions. 

67. A method fo^ achievirm/higlibandwi communications between a 
general purpose media profcessor ari^xtemal devices, comprising the steps of: 

; providing a high banpwidtn interface disposed between the media 
processor' and the external devices, the mgh bandwidth interface comprising at 
least one uni-directional channel pair having an input port and an output port; and 

transmitting and receiving a plurality of media data streams, 
comprising component fields of various sizes between the media processor and the 
external devices ay a rate that sustains substantially peak data throughput at the 
media processor. 



68. yiThe method defined in claim 67, wherein the step of providing a 
high bandwidth interface further comprises providing a plurality of external 
devices, the/plurality of external devices coupled in series on the at least one uni- 
directional/channel pair. 



The method defined in claim 67, wherein the step of providing a 
high baAdwidth interface further comprises providing a plurality of parallel uni- 
directional channel pairs. 
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70. A method for processing itreams of media data, comprising the 
steps of: / 

providing a bi-directicmal communications fabric for transmitting 
and receiving at least one stream pi unified media data, the at least one stream of 
unified media data comprising presentffl&om transmission and storage information; 

and / 1/ J 

providing at/east one programmable media processor within the 
communications network; the at least one programmable media processor for 
receiving, processing mA transmitting the at least one stream of unified media data 
over the bi-directioim communications fabric. 
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